Image taking apparatus, image reproducing apparatus, image taking method and program

ABSTRACT

To prevent information required for reproducing of a 3D/multi-viewpoint image being lost even in a case in which editing or the like of the 3D/multi-viewpoint image is performed using a device or application software that does not support 3D/multi-viewpoint images, a compound-eye digital camera can switch between a multi-viewpoint image taking mode that images a subject image viewed from a plurality of viewpoints and a single viewpoint image taking mode that takes a subject image viewed from a single viewpoint. When taking an image in the multi-viewpoint image taking mode, the compound-eye digital camera sets a protect flag for multi-viewpoint images acquired with an image pickup device and records the multi-viewpoint images. As a result, the taken multi-viewpoint images are protected, and erasure or editing of the images cannot be performed without permission.

This application is a Continuation of application Ser. No. 12/123,894filed on May 20, 2008, which has now been patented, U.S. Pat. No.8,072,485, and for which priority is claimed under 35 U.S.C. §120; andthis application claims priority of Application No. 2007-134267 filed inJapan on May 21, 2007 under 35 U.S.C. §119; the entire contents of allare hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image taking apparatus, an imagereproducing device, an image taking method, and a program, and moreparticularly to an image taking apparatus, an image reproducing device,an image taking method, and a program that prevent erroneous erasure orthe like of recorded images.

2. Description of the Related Art

The following technologies have been proposed as technologies forpreventing erroneous erasure or editing of images that are recorded withan image taking apparatus such as a digital camera.

Japanese Patent Application Laid-Open No. 2006-41699 disclosestechnology that, when performing image taking, automatically protectsagainst erasure of captured images by protecting against erasure of apreviously captured image before recording.

Japanese Patent Application Laid-Open No. 2000-115685 disclosestechnology that prevents a captured moving image being erased by anerroneous operation that deletes the base data or the like after editeddata is written.

Japanese Patent Application Laid-Open No. 2000-209535 disclosestechnology that, in a standard mode, prevent loss of important images byinhibiting overwriting of the same file inside the same folder andinhibiting an operation to delete image data.

Japanese Patent Application Laid-Open No. 11-308563 discloses technologythat prevents erasure of or a decrease in the image quality of arequired image by executing protection that inhibits a change in acompression ratio with respect to compressed image data for which theuser does not want to change the compression ratio.

SUMMARY OF THE INVENTION

In a case in which standards relating to 3D(three-dimensional)/multi-viewpoint images are decided, when a3D/multi-viewpoint image is edited and stored using a device or anapplication software that does not support the 3D/multi-viewpoint imagestandards as described in Japanese Patent Application Laid-Open Nos.2006-41699, 2000-115685 and 11-308563, the following problem may remain.

In order to ensure compatibility between 3D standards and theconventional standards, an image from a representative viewpoint in a3D/multi-viewpoint image is recorded first, and thereafter a newlyintroduced tag (3D/multi-viewpoint tag) and a 3D/multi-viewpoint imageaccording to a format in which the images of the remaining viewpointsare recorded, are recorded in a memory or the like. At this time, whenthe file of the 3D/multi-viewpoint image is read with a device or anapplication software that does not support 3D/multi-viewpoint images,the data that follows the 3D/multi-viewpoint tag is not recognized andcannot be read. When editing including resizing or rotation is performedin this state and the post-editing image is re-recorded, data requiredto reproduce the 3D/multi-viewpoint image is discarded.

The present invention has been made in consideration of the abovecircumstances, and an object of the invention is to prevent erasure ofinformation required for reproducing of a 3D/multi-viewpoint image alsoin a case in which editing of a 3D/multi-viewpoint image is performedwith a device or an application software that does not support3D/multi-viewpoint images.

An image taking apparatus according to a first aspect of the presentinvention comprises an image taking mode switching device which switchesbetween a multi-viewpoint image taking mode that takes a subject imagethat is viewed from a plurality of viewpoints and a single viewpointimage taking mode that takes a subject image that is viewed from asingle viewpoint; an image taking mode detection device which detects animage taking mode that is switched to by the image taking mode switchingdevice; an image pickup device which acquires a multi-viewpoint image ora single viewpoint image that is taken in an image taking mode that isswitched to by the image taking mode switching device; a recordingdevice which records a multi-viewpoint image or a single viewpoint imageacquired with the image pickup device on a recording medium; and aprotection setting device which, in a case where the multi-viewpointimage taking mode is detected by the image taking mode detection device,sets a protection with respect to a multi-viewpoint image that isrecorded by the recording device so that the multi-viewpoint image isnot changed or deleted.

According to the image taking apparatus of the first aspect, when takinga multi-viewpoint image in which a subject image that is viewed from aplurality of viewpoints is taken, a protection setting is set for amulti-viewpoint image recorded on the recording device so that themulti-viewpoint image is not changed or deleted. For example, in thecase of a multi-viewpoint image, this is performed by a recording methodthat sets an access flag of an image file to “write inhibit” or “readonly” or the like, or a method that changes the attributes of an imagefile by allocating a write inhibit attribute or a read only attribute orthe like to the image file. In this connection, the protection settingis performed by writing the above information in tag information that isattached to the image. Thus, since recording is carried out in a statein which protection is applied to the acquired multi-viewpoint image,even in a case in which editing or the like is performed using a deviceor an application software that does not support 3D/multi-viewpointimages, it is possible to prevent erasure of information that isrequired for playing back the 3D/multi-viewpoint image.

An image taking apparatus according to a second aspect of the presentinvention is in accordance with the image taking apparatus of the firstaspect, wherein the image pickup device comprises a plurality of imagingsystems having a plurality of optical systems and image pickup elementsthat form a subject image; a driving device which drives the pluralityof imaging systems in a case in which the multi-viewpoint image takingmode is switched to by the image taking mode switching device and whichdrives a single imaging system in a case in which the single viewpointimage taking mode is switched to by the image taking mode switchingdevice; and a drive detection device that detects whether or not drivingof the imaging system by the driving device is completed; wherein, in acase in which the multi-viewpoint image taking mode is detected by theimage taking mode detection device and the drive detection devicedetects that the plurality of imaging systems are not driving, the imagetaking mode switching device switches from the multi-viewpoint imagetaking mode to the single viewpoint image taking mode.

According to the image taking apparatus of the second aspect, when aplurality of imaging systems are not driving in a case in which themulti-viewpoint image taking mode is set, that is, when amulti-viewpoint image cannot be taken, the image taking apparatusswitches from the multi-viewpoint image taking mode to the singleviewpoint image taking mode. As a result, when a multi-viewpoint imagecannot be taken, a two-dimensional image is automatically taken and asetting can be made so as not to protect the captured image.

An image taking apparatus according to a third aspect of the presentinvention is in accordance with the image taking apparatus of the firstor second aspect, further comprising a vertical shooting detectiondevice which detects whether the image taking apparatus is in a statethat vertically shoots a subject image, wherein, in a case in which themulti-viewpoint image taking mode is switched to by the image takingmode switching device and the vertical shooting detection device detectsthat the image taking apparatus is in a state that vertically shoots asubject image, the image taking mode switching device switches from themulti-viewpoint image taking mode to the single viewpoint image takingmode.

According to the image taking apparatus of the third aspect, in a casewhere the multi-viewpoint image taking mode is set, when the imagetaking apparatus is in a state that vertically shoots a subject image,i.e. when a multi-viewpoint image cannot be taken, the image takingapparatus switches from a multi-viewpoint image taking mode to a singleviewpoint image taking mode. As a result, when a multi-viewpoint imagecannot be taken, a setting can be made to automatically capture atwo-dimensional image and not protect the captured image.

An image taking apparatus according to a fourth aspect of the presentinvention is in accordance with the image taking apparatus according toany of the first to third aspects, further comprising an erase modesetting device which, in a case where images including themulti-viewpoint image are recorded in the recording device, sets anerase mode that erases a desired image that is selected from among theimages; an erase mode detection device which detects whether or not theerase mode is set; a warning device which, when the desired image is themulti-viewpoint image in a case where the erase mode is detected by theerase mode detection device, issues a warning to the effect that themulti-viewpoint image is to be erased; and an erasing device which, in acase where selection of the multi-viewpoint image is confirmed after awarning is issued by the warning device, cancels the protection that isset for the selected multi-viewpoint image and erases themulti-viewpoint image.

According to the image taking apparatus of the fourth aspect, a warningis issued when a multi-viewpoint image is selected in an erase modewhich erases a desired image that is selected from among imagesincluding a multi-viewpoint image that are recorded using a recordingdevice. When selection of the multi-viewpoint image is confirmed afterthe warning, protection of the multi-viewpoint image is cancelled andthe image is erased. As a result, since a warning is issued beforeerasing a multi-viewpoint image, it is possible to prevent a usererroneously erasing a multi-viewpoint image. For example, by assigning aread protection setting to a multi-viewpoint image using a protect flag,the user can edit the image after taking care to copy the3D/multi-viewpoint image using a different file name.

An image taking apparatus according to a fifth aspect of the presentinvention is in accordance with the image taking apparatus according toany of the first to fourth aspects, further comprising an edit modesetting device which, in a case where images including themulti-viewpoint image are recorded in the recording device, sets an editmode that edits a desired image that is selected from among the images;an edit mode detection device that detects whether or not the edit modeis set; a warning device which, when the desired image is themulti-viewpoint image in a case where the edit mode is detected by theedit mode detection device, issues a warning to the effect that themulti-viewpoint image is to be edited; a protection canceling devicewhich, in a case where selection of the multi-viewpoint image isconfirmed after a warning is issued by the warning device, cancels theprotection that is set for the selected multi-viewpoint image; and anediting device which edits a multi-viewpoint image for which aprotection is cancelled by the protection canceling device; wherein therecording device records a multi-viewpoint image that is edited by theediting device on a recording medium, and the protection setting devicesets a protection with respect to the edited multi-viewpoint image thatis recorded by the recording device so that the multi-viewpoint image isnot changed or deleted.

According to the image taking apparatus of the fifth aspect, a warningis issued when a multi-viewpoint image is selected in an edit mode whichedits a desired image that is selected from among images including amulti-viewpoint image that are recorded using a recording device. Whenselection of the multi-viewpoint image is confirmed after the warning,protection of the multi-viewpoint image is cancelled and the image isedited. The image taking apparatus records an edited multi-viewpointimage on a recording device and sets a protection so that themulti-viewpoint image is not changed or deleted. As a result, since awarning is issued before executing editing of a multi-viewpoint image,it is possible to prevent a user erroneously editing a multi-viewpointimage. Further, since an edited image is protected, it is possible toappropriately safeguard the edited image.

An image taking apparatus according to a sixth aspect of the presentinvention is in accordance with the image taking apparatus of the fifthaspect, wherein the recording device records a multi-viewpoint imagethat is edited with the editing device on the recording device afterissuing a warning again.

According to the image taking apparatus of the sixth aspect, a warningis issued again before recording an edited multi-viewpoint image on arecording device. As a result, in a case where a multi-viewpoint imageis edited, it is possible to prevent the user from erroneously savingthe edited image.

An image reproducing apparatus according to a seventh aspect of thepresent invention comprises a connection device to which a recordingmedium than can record a subject image is connected; a detection devicethat detects that the recording medium is connected to the connectiondevice; a first judgment device which, in a case where connection of therecording medium is detected by the detection device, judges whether ornot a multi-viewpoint image that is a subject image that is viewed froma plurality of viewpoints is recorded on the recording medium; a firstprotection setting device which, in a case where the first judgmentdevice judges that the multi-viewpoint image is recorded, sets aprotection with respect to the recorded multi-viewpoint image so thatthe multi-viewpoint image is not changed or deleted.

According to the image reproducing apparatus of the seventh aspect, in acase where a multi-viewpoint image is recorded on the recording mediumwhen a recording medium than can record a subject image is connected,the image reproducing apparatus sets a protection with respect to therecorded multi-viewpoint image so that the multi-viewpoint image is notchanged or deleted. It is therefore possible to automatically protect amulti-viewpoint image that is taken with a device that does notautomatically protect a 3D/multi-viewpoint image.

An image reproducing apparatus according to an eighth aspect of thepresent invention is in accordance with the image reproducing apparatusof the seventh aspect, further comprising a second judgment devicewhich, when the detection device detects that the recording medium isconnected, judges whether or not a new subject image can be recorded onthe recording medium; and a second protection setting device which, whenthe second judgment device judges that a new subject image cannot berecorded on the recording medium, sets a protection with respect to therecording medium so that a multi-viewpoint image or a single viewpointimage that is recorded on the recording medium is not changed ordeleted.

According to the image reproducing apparatus of the eighth aspect, whena new subject image cannot be recorded on a connected recording medium,the image reproducing apparatus sets a protection with respect to therecording medium so that data such as a multi-viewpoint image or asingle viewpoint image that is recorded on the recording medium is notchanged or deleted. Since it is thereby possible to provide doubleprotection for a multi-viewpoint image included in a recording medium,safeguarding of image data can be further enhanced.

An image taking apparatus according to a ninth aspect of the presentinvention is in accordance with an image taking apparatus according toany one of the first to sixth aspects, further comprising an imagereproducing apparatus according to the seventh or eighth aspect.

An image taking method according to a tenth aspect of the presentinvention comprises a step of switching between a multi-viewpoint imagetaking mode that takes a subject image that is viewed from a pluralityof viewpoints and a single viewpoint image taking mode that takes asubject image that is viewed from a single viewpoint; a step ofdetecting the image taking mode that is switched to; a step of acquiringa multi-viewpoint image or a single viewpoint image that is taken in theimage taking mode that is switched to; a step of recording themulti-viewpoint image or single viewpoint image that is acquired on arecording medium; and a step of, in a case where the multi-viewpointimage taking mode is detected in the step of detecting the image takingmode, setting a protection setting with respect to the recordedmulti-viewpoint image so that the multi-viewpoint image is not changedor deleted.

An image taking method according to an eleventh aspect of the presentinvention comprises a step in which a recording medium that can record asubject image is connected; a step of detecting that the recordingmedium is connected; a step of, in a case in which connection of therecording medium is detected, judging whether or not a multi-viewpointimage that is a subject image that is viewed from a plurality ofviewpoints is recorded on the recording medium; and when it is judgedthat the multi-viewpoint image is recorded in the step of judgingwhether or not the multi-viewpoint image is recorded on the recordingmedium, a step of setting a protection setting with respect to therecorded multi-viewpoint image so that the multi-viewpoint image is notchanged or deleted.

A program according to a twelfth aspect causes an arithmetic and logicunit to execute an image taking method according to the tenth oreleventh aspect.

According to the present invention, even when performing editing or thelike of a 3D/multi-viewpoint image with a device or an applicationsoftware that does not support 3D/multi-viewpoint images, it is possibleto prevent erasure of information necessary for playing back a3D/multi-viewpoint image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a compound-eye digital camera 1 a to whichthe present invention is applied;

FIG. 2 is a flowchart that illustrates processing of a first embodimentthat sets a protect flag and captures and records image data of athree-dimensional image;

FIG. 3 is a flowchart that illustrates processing of a second embodimentthat sets a protect flag and captures and records image data of athree-dimensional image;

FIG. 4 is a flowchart that illustrates processing in a case in which amemory card on which a three-dimensional image is recorded is inserted;

FIG. 5 is a flowchart that illustrates processing in a case in which amemory card on which a three-dimensional image is recorded is inserted;

FIG. 6 is a flowchart that illustrates the flow of processing thaterases a three-dimensional image; and

FIG. 7 is a flowchart that illustrates the flow of processing that editsa three-dimensional image.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereunder, preferred embodiments for implementing a changeable-lens typedigital camera with integrated image pickup element according to thepresent invention are described in detail in accordance with theattached drawings.

FIG. 1 is a block diagram that shows the electrical configuration of acompound-eye digital camera 1. The compound-eye digital camera 1 iscapable of taking a single viewpoint image (two-dimensional image) and amulti-viewpoint image (three-dimensional image), and is also capable ofrecording and reproducing of moving images, still images, and sounds.Further, taking of a multi-viewpoint image, and not just a singleviewpoint image, is also possible for both moving images and stillimages.

The compound-eye digital camera 1 principally includes two imagingsystems constituted by a first imaging system 2 a and a second imagingsystem 2 b, an operation portion 3 that allows a user to perform variousoperations when using the compound-eye digital camera 1, an operationdisplay LCD 4 for providing assistance with operations, release switches5 a and 5 b, and an image display LCD 6.

The first imaging system 2 a and the second imaging system 2 b arearranged in parallel so that lens optical axes L1 and L2 thereof areparallel or form a predetermined angle.

The first imaging system 2 a is configured by a first zoom lens 11 athat is arranged along the lens optical axis L1, a first iris 12 a, afirst focus lens 13 a, and a first image sensor 14 a. An iris controlportion 16 a is connected to the first iris 12 a, and a timing generator(TG) 18 a is connected to the first image sensor 14 a. Operations of thefirst focus lens 13 a and the first iris 12 a are controlled by aphotometric and distance-measuring CPU 19 a. Operations of the TG 18 aare controlled by a main CPU 10.

In accordance with a zoom operation from the operation portion 3, thefirst zoom lens 11 a changes the zoom magnification ratio by movingalong the lens optical axis L1 to a NEAR side (extended side) or an INFside (a retracted side). This movement is driven by an unshown motor.

The first iris 12 a changes an opening value (aperture value) at a timeof an AE (Auto Exposure) operation to restrict a luminous flux andadjust the exposure.

The first focus lens 13 a performs focus adjustment by moving to theNEAR side or the INF side along the lens optical axis L1 at the time ofan AF (Auto Focus) operation to change the focus position. This movementis driven by an unshown motor. When a half-pressed state of the releaseswitch 5 a for still images is detected, the main CPU 10 obtains rangedata from the first image sensor 14 a. Based on the obtained range data,the main CPU 10 adjusts the focus and iris and the like.

The first image sensor 14 a is a CCD or CMOS type image sensor thatreceives light of a subject which is subjected to image formation by thefirst zoom lens 11 a, the first iris 12 a, and the first focus lens 13a, and stores a photo-electric charge that corresponds to the amount ofreceived light at a light receiving element. A photo-electric chargestorage and transfer operation of the first image sensor 14 a iscontrolled by the TG 18 a. An electronic shutter speed (photo-electriccharge storage time) is determined by a timing signal (clock pulse) thatis input from the TG 18 a. When in an image taking mode, the first imagesensor 14 a acquires an image signal for one frame at each predeterminedperiod.

The second imaging system 2 b has the same configuration as the firstimaging system 2 a, and is configured by a second zoom lens 11 b, asecond iris 12 b, a second focus lens 13 b, and a second image sensor 14b to which a timing generator (TG) 18 b is connected.

Operations of the first imaging system 2 a and the second imaging system2 b are controlled by the main CPU 10. Although the first imaging system2 a and the second imaging system 2 b basically perform operations inresponse to each other, it is also possible for the first imaging system2 a and the second imaging system 2 b to be operated independently fromeach other.

Imaging signals output from the first image sensor 14 a and the secondimage sensor 14 b of the first imaging system 2 a and the second imagingsystem 2 b are input to A/D converters 30 a and 30 b, respectively.

The A/D converters 30 a and 30 b convert the input image data fromanalog to digital data. The imaging signals of the first image sensor 14a are output as first image data (image data for right eye) and theimaging signals of the second image sensor 14 b are output as secondimage data (image data for left eye) via the A/D converters 30 a and 30b.

Image signal processing circuits 31 a and 31 b respectively subject thefirst image data and the second image data input from the A/D converters30 a and 30 b to various kinds of image processing such as gradationconversion, white balance correction, and γ-correction processing.

Buffer memories 32 a and 32 b temporarily store first image data andsecond image data that undergo various kinds of image processing at theimage signal processing circuits 31 a and 31 b. The first image data andthe second image data that are stored in the buffer memories 32 a and 32b are output via a system bus.

The main CPU 10, an EEPROM 21, work memories 24 a and 24 b, buffermemories 32 a and 32 b, a controller 34, YC processing portions 35 a and35 b, compression/expansion processing circuits 36 a and 36 b, a mediacontroller 37, a vertical shooting detection circuit 50, a verticalshooting flag setting circuit 51, a protect flag setting circuit 52, anda 2D/3D mode switching flag setting circuit 53 are connected to thesystem bus.

The main CPU 10 performs unified control of the overall operations ofthe compound-eye digital camera 1. The operation portion 3, releaseswitches 5 a and 5 b, a protection cancellation switch 7, a 2D/3Dsetting switch 8, and a vertical shooting setting button 9 are connectedto the main CPU 10.

The operation portion 3 comprises a power switch for turning on thepower to operate the compound-eye digital camera 1, a mode dial forselecting automatic exposure or manual exposure or the like, cross keysfor setting or selecting various menus or for performing a zoomoperation, a switch for emitting a flash light, and an informationposition specification key for executing or cancelling a menu that isselected with the cross keys. By performing an appropriate operation atthe operation portion 3, operations such as turning the power on or off,switching to various modes (image taking mode, reproducing mode, erasemode, edit mode and the like), and zooming can be performed.

The release switches 5 a and 5 b have a two-stage switch configuration.When the release switch 5 a or 5 b is lightly pressed (semi-depressed)when in the image taking mode, an AF operation and an AE operation areperformed as image taking preparation processing. When the releaseswitches 5 a, 5 b are pressed strongly (fully depressed) in this state,exposure processing is performed and first image data and second imagedata for one frame are transferred from a frame memory 32 to a memorycard 38 and recorded.

An image display LCD 6 is a 3D monitor according to a parallax barriersystem or a lenticular lens system. The image display LCD 6 is used asan electronic view finder at a time of image exposure. At a time ofimage reproducing, the image display LCD 6 performs stereoscopic displayof image data obtained by image taking. Although the detailed structureof the image display LCD 6 is not illustrated, the image display LCD 6comprises a parallax barrier display layer on the surface thereof. Whenperforming a stereoscopic display, the image display LCD 6 generates aparallax barrier comprising a pattern in which a light transmittingportion and a light blocking portion are alternately aligned at apredetermined pitch on the parallax barrier display layer, and enablesstereoscopic views by alternately arranging and displaying strip-shapedimage fragments that show left and right images on an image displayscreen on a lower layer thereof. In this connection, there is nonecessity to limit the configuration of a display device that enablestereoscopic views to a parallax system using a slit array sheet, and alenticular system using a lenticular lens sheet, an integral photographysystem using a micro-lens array sheet, and a holography system using aninterference phenomenon may also be employed.

The protection cancellation switch 7 is a switch for specifying releaseof protection of an image for which erasure, editing, or the like isinhibited.

A 2D/3D setting switch 8 is a switch for specifying switching between a2D mode that captures a single viewpoint image and a 3D mode thatcaptures a multi-viewpoint image.

A vertical shooting setting button 9 is a button for specifying whetherto perform image taking using either vertical shooting or horizontalshooting. In this connection, a configuration may be adopted in whichselection of vertical shooting/horizontal shooting is performed bymaking a menu selection.

An EEPROM 21 is a non-volatile memory that stores setting information orprograms for various kinds of control and the like. The main CPU 10executes various kinds of processing based on the programs or settinginformation.

Work memories 24 a and 24 b respectively store YC signals that areprocessed at the YC processing portions 35 a and 35 b.

A controller 34 reads out YC signals of first image data and secondimage data stored in the work memories 24 a and 24 b to the YC/RGBprocessing portion 22.

The YC/RGB processing portion 22 converts YC signals of the first imagedata and the second image data into video signals of a predeterminedformat (for example, a composite color video signal in NTSC format), andthen synthesizes the video signals with stereoscopic image data forperforming a stereoscopic display on the image display LCD 6 and outputsthe resulting data to a LCD driver for display 23. When the imagedisplay LCD 6 is used as an electronic view finder in an image takingmode, stereoscopic image data that is synthesized by the YC/RGBprocessing portion 22 is displayed as a through image on the imagedisplay LCD 6 via an LCD driver 23. Further, when performing astereoscopic display of image data obtained by image taking, the YC/RGBprocessing portion 22 reads out the respective image data that isrecorded on the memory card 38 using the media controller 37, convertsdata that is subjected to expansion processing by thecompression/expansion processing circuits 36 a and 36 b intostereoscopic image data, and displays that stereoscopic image data onthe image display LCD 6 as a reproduced image via the LCD driver 23.

The LCD driver 23 outputs RGB signals output from the YC/RGB processingportion 22 to the image display LCD 6.

YC processing portions 35 a and 35 b converts image data stored in thebuffer memories 32 a and 32 b into luminance signals (Y signals) andcolor-difference signals (Cr an Cb signals), and also performspredetermined processing such as gamma correction.

Compression/expansion processing circuits 36 a and 36 b performcompression/expansion processing on first image data and second imagedata stored in the respective work memories 24 a and 24 b, in accordancewith predetermined compression/expansion formats such as JPEG for stillimages and MPEG2, MPEG4, or H.264 format for moving images.

A media controller 37 records each image data that undergoescompression/expansion processing by the compression/expansion processingcircuits 36 a and 36 b on a memory card 38 that is connected via an I/F39, or other recording media.

The memory card 38 may be various recording media that can be removablyinserted into the compound-eye digital camera 1 such as an XD picturecard (registered trademark), a semi-conductor memory card represented bysmart media (registered trademark), a portable small-sized hard disk, amagnetic disc, an optical disk, or a magneto-optical disk.

A vertical shooting detection circuit 50 detects whether to performimage taking using vertical shooting or horizontal shooting, using asensor that utilizes gravity or a sensor utilizing a Hall device or MEMSor the like.

A vertical shooting flag setting circuit 51 sets a flag indicating thatthe compound-eye digital camera 1 is in vertical shooting mode.

A protect flag setting circuit 52 sets an erase inhibit flag, an editinhibit flag, an overwrite inhibit flag and the like. Normally, if thereis an erase inhibit flag, erasure, overwriting and editing can beinhibited. By adopting a configuration in which, in addition to an eraseinhibit flag, an edit inhibit flag and an overwrite inhibit flag can beindividually provided and set. In that case, it is possible to inhibitediting, and when editing is to be performed, a file that is copiedunder a different name can be edited. At this time, by making a settingthat enables erasure even when editing is inhibited, it is possible tofacilitate an erasure operation as long as the contents of a file can beascertained.

A flag representing whether a mode is a 2D mode or a 3D mode is set in a2D/3D mode switching flag setting circuit 53. In this connection, aconfiguration may be adopted in which erasure, editing, overwriting andthe like can all be inhibited with one flag, and not just aconfiguration in which an edit inhibit flag, an overwrite inhibit flagor the like is individually provided as a protect flag.

The vertical shooting flag, the protect flag, and the 2D/3D modeswitching flag are written in tag information that is attached to anacquired image file, a folder, or the memory card 38 or the like.

A power supply battery 68 is detachably mounted in the compound-eyedigital camera 1.

The power supply battery 68 comprises a chargeable secondary battery,for example, a nickel-cadmium battery, a nickel hydrogen battery, or alithium ion battery. The power supply battery 68 may also comprise athrowaway primary battery, for example, a lithium battery or an alkalinebattery. By loading the power supply battery 68 in an unshown batterystorage chamber, the power supply battery 68 is electrically connectedwith each circuit of the compound-eye digital camera 1.

Charging and light emission control portions 43 a and 43 b receive asupply of electric power from the power supply battery 68 and, in orderto cause electronic flashes 44 a and 44 b to emit light, respectively,charge an unshown capacitor for emitting a flash light and control lightemission of the electronic flashes 44 a and 44 b.

In accordance with various signals such as semi-depression and fulldepression operation signals of the release switches 5 a and 5 b andsignals indicating a light emission amount and light emission timingthat are incorporated from the main CPU 10 or photometric anddistance-measuring CPUs 19 a and 19 b, the charging and light emissioncontrol portions 43 a and 43 b perform current supply control to theelectronic flashes 44 a and 44 b and execute control so that the desiredlight emission amount is obtained at the desired timing.

Although according to the compound-eye digital camera 1 shown in FIG. 1an example is illustrated that has two imaging systems (first imagingsystem 2 a and second imaging system 2 b), three or more imaging systemsmay be included. Further, the imaging systems need not be disposed in asingle horizontal row, and may be disposed two-dimensionally.

Further, instead of providing a release button for each imaging systemas in the above described compound-eye digital camera 1, only onerelease button may be provided.

The compound-eye digital camera 1 shown in FIG. 1 is capable of not onlystereoscopic image taking, but also image taking from multiple aspectsor from all directions.

Image taking, recording operations, and reproducing operations of thecompound-eye digital camera 1 configured as described above will now bedescribed.

In the compound-eye digital camera 1, when a power supply button (notshown) is turned on, the main CPU 10 detects that the power supplybutton is on and turns on the power supply inside the camera to put thecamera in an image taking standby state in image taking mode. Further,the user sets either the 2D mode or the 3D mode using the 2D/3D settingswitch 8. As necessary, the user depresses the vertical shooting settingbutton 9 to set vertical shooting.

In this image-taking standby state, the main CPU 10 normally displays amoving image (through image) on the image display LCD 6.

First, the main CPU 10 refers to the 2D/3D mode switching flag settingcircuit 53 to detect either the 2D mode that acquires a single viewpointimage (two-dimensional image) or the 3D mode that acquires amulti-viewpoint image (three-dimensional image). For the 2D mode themain CPU 10 drives only the first imaging system 2 a, and for the 3Dmode the main CPU 10 drives the first imaging system 2 a and the secondimaging system 2 b. Hereunder, a description is given taking the 3D modeas an example.

The first zoom lens 11 a, the second zoom lens 11 b, the first focuslens 13 a, and the second focus lens 13 b are extended as far as apredetermined position, and thereafter image taking for a through imageis performed by the first image sensor 14 a and the second image sensor14 b to display a through image on the image display LCD 6. That is,images are continuously captured by the first image sensor 14 a and thesecond image sensor 14 b, and the image signals thereof are continuouslyprocessed to generate image data for a through image. The generatedimage data is sequentially applied to the controller 34 and convertedinto a signal format for display, and then output to the image displayLCD 6. Thus, the images captured by the first image sensor 14 a and thesecond image sensor 14 b are displayed in a through condition on theimage display LCD 6.

A user (photographer) performs framing, checks the subject to be taken,checks the image after image taking, and sets image taking conditionsand the like while viewing the through images displayed on the imagedisplay LCD 6.

When the release switches 5 a and 5 b are semi-depressed in the abovedescribed image taking standby state, an S1 ON signal is input to themain CPU 10. The main CPU 10 detects that signal and performs AEphotometry and AF control. At the time of AE photometry, the main CPU 10performs photometry with respect to the brightness of the subject basedon integrated values of image signal that are incorporated through thefirst image sensor 14 a and the second image sensor 14 b and the like.The value obtained by this photometry (photometric value) is used todecide the aperture value of the first iris 12 a and second iris 12 band the shutter speed at the time of the actual image taking. At thesame time, the main CPU 10 determines whether or not luminescence of theelectronic flashes is required based on the detected subject brightness.When the main CPU 10 determines that light emission of the electronicflashes 44 a and 44 b is required, the main CPU 10 causes the electronicflashes 44 a and 44 b to perform a preliminary light emission. The mainCPU 10 decides the light emission amounts of the electronic flashes 44 aand 44 b at the time of actual image taking based on the reflected lightfrom the preliminary light emission. The main CPU 10 also determineswhether vertical shooting or horizontal shooting is to be performedusing the vertical shooting detection circuit 50.

When the release switches 5 a and 5 b are depressed fully, an S2 ONsignal is input to the main CPU 10. In response to the S2 ON signal, themain CPU 10 executes image taking and recording processing.

First, the main CPU 10 drives the first iris 12 a and the second iris 12b via the iris control portions 16 a and 16 b based on aperture valuesthat are determined based on the aforementioned photometric value, andalso controls a charge storage time (the so-called electronic shutter)at the first image sensor 14 a and the second image sensor 14 b toattain the shutter speed that is determined based on the photometricvalue.

Further, the main CPU 10 calculates AF evaluation values and AEevaluation values based on the first image data and the second imagedata, respectively, that are stored in the buffer memories 32 a and 32b. The AF evaluation values are calculated by integrating high frequencycomponents of luminance values for the entire area or a predeterminedregion (for example, the center part) of each piece of image data, andrepresent the sharpness of the image. The term “high frequency componentof a luminance value” refers to a value obtained by totaling luminancedifferences (contrasts) between adjoining pixels within a predeterminedregion. The AE evaluation value is calculated by integrating luminancevalues for the entire region or a predetermined region (for example, thecenter part) of each piece of image data, and represents the brightnessof an image. The AF evaluation values and the AE evaluation values arerespectively used for an AF operation and an AE operation that areexecuted at the time of image-taking preparation processing describedhereunder.

The main CPU 10 performs an AF operation (contrast AF) by determiningthe maximum value of AF evaluation values that are calculated based oneach of the first image data and the second image data that aresequentially obtained while the main CPU 10 controls the first focuslens 13 a and the second focus lens 13 b to move the first focus lens 13a and the second focus lens 13 b in a predetermined direction,respectively.

At this time, when causing the electronic flashes 44 a and 44 b to emitlight, the main CPU 10 causes the electronic flashes 44 a and 44 b toemit light based on the light emission amount of the electronic flashes44 a and 44 b determined based on the results of preliminary-lightemission.

The subject light is incident on a light receiving surface of the firstimage sensor 14 a via the first zoom lens 11 a, the first iris 12 a, andthe first focus lens 13 a. The subject light is also incident on a lightreceiving surface of the second image sensor 14 b via the second zoomlens 11 b, the second iris 12 b, and the second focus lens 13 b.

The first image sensor 14 a and the second image sensor 14 b comprise acolor CCD in which color filters for R, G, and B of a predeterminedcolor filter array (for example, a honeycomb array or a Bayer array) areprovided. Light that is incident on a light receiving surface of thefirst image sensor 14 a and the second image sensor 14 b is convertedinto a signal charge of an amount that corresponds to the amount ofincident light by each photodiode arranged on the light receivingsurface. Signal charges that are accumulated at the respectivephotodiodes are read out in accordance with a timing signal that isapplied from the timing generator (TG) 18 a, output sequentially fromthe first image sensor 14 a and the second image sensor 14 b as voltagesignals (image signals), and input to the A/D converters 30 a and 30 b.

The A/D converters 30 a and 30 b include a CDS circuit and an analogamplifier. The CDS circuit performs correlated double samplingprocessing of a CCD output signal based on a CDS pulse. The analogamplifier amplifies an image signal output from a CDS circuit using again for setting imaging sensitivity that is applied from the main CPU10. At the A/D converters 30 a and 30 b, the respective analog imagesignals are converted into digital image signals.

The first image data and the second image data output from the A/Dconverters 30 a and 30 b are subjected to various kinds of imageprocessing such as gradation conversion, white balance correction,γ-correction processing at the image signal processing circuits 31 a and31 b, respectively, and then temporarily stored in the buffer memories32 a and 32 b.

R, G, and B image signals read out from the buffer memories 32 a and 32b are converted to a luminance signal Y and color-difference signals Crand Cb (YC signals) by the YC processing portions 35 a and 35 b. The Ysignal is subjected to edge enhancement processing by an edge correctioncircuit. The YC signals processed at the YC processing portions 35 a and35 b are stored in the respective work memories 24 a and 24 b.

The YC signals stored in the buffer memories 32 a and 32 b in the mannerdescribed above are compressed by the compression/expansion processingcircuits 36 a and 36 b and recorded in the memory card 38 as an imagefile of a predetermined format via the I/F 39. In the case of thecompound-eye digital camera 1 according to the present example, the dataof a two-dimensional image that is a still image is stored in the memorycard 38 as an image file in accordance with Exif standards. An Exif filehas a region that stores data of a main image and a region that storesdata of a reduced image (thumbnail image). A thumbnail image of aprescribed size (for example, 160×120 or 80×60 pixels or the like) isgenerated by performing pixel thinning processing based on data on themain image that is acquired by image taking and other necessary dataprocessing. The thumbnail image generated in this manner is writteninside the Exif file together with the main image. Further, taginformation such as the image taking data and time, image takingconditions, face detection information and the like is attached to theExif file. Data of a moving image is stored in the memory card 38 afterundergoing compression and expansion processing according to apredetermined compression and expansion format such as MPEG2, MPEG4, orH.264 format.

When recording image data of a three-dimensional image in the memorycard 38, the protect flag setting circuit 52 writes the protect flaginto tag information that is attached to the image data. Image data thatis written by the protect flag setting circuit 52 or the like is storedin the memory card 38 as an image file for which protection is set(described in detail later). Further, when vertical shooting is detectedwith the vertical shooting detection circuit 50, the vertical shootingflag setting circuit 51 writes the vertical shooting flag into taginformation that is attached to the image data. In this connection, whenimage taking is performed in the 2D mode, the protect flag is not set.

Image data that is recorded in the memory card 38 in this manner isreproduced and displayed on the image display LCD 6 by setting the modeof the compound-eye digital camera 1 to reproducing mode. Switching overto reproducing mode is performed by depressing a reproducing button (notshown).

When the reproducing mode is selected, the image file of a final framerecorded on the memory card 38 is read out through the I/F 39. Thecompressed data of the image file that is read out is expanded intouncompressed YC signals through the compression/expansion processingcircuits 36 a and 36 b.

The expanded YC signals are held in buffer memories 32 a and 32 b (or anunshown VRAM), converted into a signal format for display by thecontroller 34, and output to the image display LCD 6. As a result, theimage of the final frame recorded in the memory card 38 is displayed onthe image display LCD 6.

Thereafter, when a forward frame feeding switch (right-side key of crosskeys) is pressed, frames are fed in the forward direction, and when areverse frame feeding switch (left-side key of cross keys) is pressed,frames are fed in the reverse direction. The image file at the frameposition to which the frame is fed is then read out from the memory card38, and the image is played back on the image display LCD 6 in the samemanner as described above.

As necessary, a user can erase an image recorded on the memory card 38while checking the image that is reproduced and displayed on the imagedisplay LCD 6. Erasure of an image is performed by pressing a photo modebutton in a state in which the image is played back and displayed on theimage display LCD 6. A detailed description is given later regardingerasing an image.

The compound-eye digital camera 1 carries out image taking, recording,and reproducing of an image in the manner described above. Although theabove description described the case of taking a still image, the sameapplies to the case of a moving image. Taking of moving images and stillimages is controlled by respective release buttons. A configuration mayalso be adopted in which switching between a moving image and a stillimage is performed using a menu or a mode select SW for moving imagesand still images.

<Regarding Image Taking and Recording of Three-Dimensional Images>

A method that sets the protect flag and takes and records image data ofa three-dimensional image is described hereunder.

First Embodiment

FIG. 2 is a flowchart that illustrates the flow of a series ofoperations to take and record an image in 3D mode. The main CPU 10performs control in accordance with this flowchart.

The main CPU 10 determines whether or not an image taking instruction isinput (step S10). If an image taking instruction has been not input (Noat step S10), the main CPU 10 returns to step S10 again. If an imagetaking instruction has been input (Yes at step S10), detection isperformed regarding whether the 2D/3D setting switch 8 is set to 3D modeor set to 2D mode (step S11).

The main CPU 10 determines whether or not the 2D/3D setting switch 8 isset to the 3D mode (step S12). When the 2D/3D setting switch 8 is set tothe 3D mode (Yes at step S12), the main CPU 10 switches the operationmode to the 3D mode (step S13). When the 2D/3D setting switch 8 is setto the 2D mode (No at step S12), the main CPU 10 switches the imagetaking mode to the 2D mode (step S19).

First, the case of the 2D mode is described (steps S19 to S21).

For the 2D mode, the protect flag setting circuit 52 is set to “off”(step S20), one predetermined imaging system is driven, and acquisitionof a two-dimensional image is performed (step S21). According to thepresent embodiment, only the first imaging system 2 a is driven.

Next, the case of the 3D mode is described (steps S14 to S18).

For the 3D mode, the protect flag setting circuit 52 is set to “on”(step S14), and an operation test is performed for a plurality ofimaging systems (first imaging system 2 a and second imaging system 2 b)(step S15).

In the operation test, the operating status of the plurality of imagingsystems is acquired (step S16), and the main CPU 10 determines whetheror not the plurality of imaging systems operate (step S17). When theplurality of imaging systems do not operate normally (No at step S17),the main CPU 10 switches to the 2D mode (step S19). When the pluralityof imaging systems operate normally (Yes at step S17), driving of theplurality of imaging systems is controlled to acquire athree-dimensional image (step S18).

Next, file initialization is performed (step S22), image data of thetwo-dimensional image or three-dimensional image that is acquired istaken in and recorded in the memory card 38 (step S23).

The main CPU 10 then determines whether or not image taking is completed(step S24). When the main CPU 10 determines that image taking is notcompleted (No at step S24), the main CPU 10 determines whether or not apredetermined time has elapsed after image taking and recording isperformed at step S23 (step S25). When the predetermined time has notelapsed (No at step S25), step S25 is performed again. When thepredetermined time has elapsed (Yes at step S25), the main CPU 10returns to the step that performs image taking and recording (step S23).

If the main CPU 10 determines that image taking is completed (Yes atstep S24), the header information of the image data recorded at step S23is updated (step S26). More specifically, when image taking is performedin 3D mode, the image data of the three-dimensional image that isacquired is recorded in the memory card 38 in a state in which theprotect flag that is set to “on” at step S14 is written in the header.

Although the above description described a case of taking a still image,the same situation applies to a case of taking moving images. Sincemoving images are consecutively taken, a protect flag can also bewritten at the same time when writing information such as the imagetaking time of a moving image.

By automatically setting a protect flag and performing image taking andrecording of a three-dimensional image in this manner, it is possible toprotect the three-dimensional image so that it is not erased and also toprevent deletion of information required for reproducing of thethree-dimensional image even in a case in which a three-dimensionalimage that is taken using a device that supports three-dimensionalimages is edited or the like with a device that only supportstwo-dimensional images.

Further, since the three-dimensional image is protected, a configurationcan be adopted in which the three-dimensional image is not erased evenby carelessness or erroneous operation of the user.

Although according to the present embodiment the protect flag is set to“on” in the case of a three-dimensional image, a configuration may beadopted in which the image is recorded with the access flag of the imagefile set to “write inhibit”.

Second Embodiment

To form a three-dimensional image, at least two two-dimensional imagesthat are taken from different angles in the horizontal direction arerequired. When taking an image by vertical shooting using thecompound-eye digital camera 1, since two-dimensional images cannot beobtained from different angles in the horizontal direction, it is notpossible to form a three-dimensional image.

According to the second embodiment that sets the protect flag and takesand records image data of a three-dimensional image, the main CPU 10determines whether vertical shooting of horizontal shooting is to beperformed in the 3D mode, and when vertical shooting is to be performed,the main CPU 10 switches from the 3D mode to the 2D mode. FIG. 3 is aflowchart that illustrates the flow of a series of operations of thesecond embodiment that takes and records an image in 3D mode. The mainCPU 10 performs control in accordance with this flowchart. In thisconnection, sections that are the same as in the first embodiment areassigned the same reference numerals, and a detailed description ofthose sections is omitted.

The main CPU 10 determines whether or not an image taking instruction isinput (step S10). If an image taking instruction has been not input (Noat step S10), the main CPU 10 returns to step S10 again. If an imagetaking instruction has been input (Yes at step S10), it is determinedwhether the 2D/3D setting switch 8 is set to the 3D mode or set to the2D mode (step S11).

The main CPU 10 determines whether or not the 2D/3D setting switch 8 isset to the 3D mode (step S12). When the 2D/3D setting switch 8 is set tothe 3D mode (Yes at step S12), the main CPU 10 switches the operationmode to the 3D mode (step S13). When the 2D/3D setting switch 8 is setto the 2D mode (No at step S12), the main CPU 10 switches the imagetaking mode to the 2D mode (step S19).

In the case of the 2D mode (step S19), the protect flag setting circuit52 is set to “off” (step S20), one predetermined imaging system isdriven, and acquisition of a two-dimensional image is performed (stepS21).

In the case of the 3D mode (step S13), the protect flag setting circuit52 is set to “on” (step S14), and an operation test is performed for aplurality of imaging systems (first imaging system 2 a and secondimaging system 2 b) (step S15).

In the operation test, the operating status of the plurality of imagingsystems is acquired (step S16), and the main CPU 10 determines whetheror not the plurality of imaging systems operate (step S17). When theplurality of imaging systems do not operate normally (No at step S17),the main CPU 10 switches to the 2D mode (step S19).

When the plurality of imaging systems operate normally (Yes at stepS17), information indicating whether or not vertical shooting is to beperformed is acquired from the vertical shooting detection circuit 50(step S27), and the main CPU 10 determines whether or not thecompound-eye digital camera 1 is in the vertical shooting mode thatacquires images by vertical shooting (step S28).

When the compound-eye digital camera 1 is in the vertical shooting mode(Yes at step S28), the main CPU 10 switches to the 2D mode since athree-dimensional image cannot be acquired (step S19).

When the compound-eye digital camera 1 is not in the vertical shootingmode (No at step S28), since a three-dimensional image can be acquired,the plurality of imaging systems are drivingly controlled to acquire athree-dimensional image (step S18).

Next, file initialization is performed (step S22), image data of thetwo-dimensional image or three-dimensional image that is acquired istaken in, and that image data is recorded in the memory card 38 (stepS23).

The main CPU 10 then determines whether or not image taking is completed(step S24). When the main CPU 10 determines that image taking is notcompleted (No at step S24), the main CPU 10 determines whether or not apredetermined time has elapsed after image taking and recording isperformed at step S23 (step S25). When the predetermined time has notelapsed (No at step S25), step S25 is performed again. When thepredetermined time has elapsed (Yes at step S25), the main CPU 10returns to the step that performs image taking and recording (step S23).

If the main CPU 10 determines that image taking is completed (Yes atstep S24), the header information of the image data recorded at step S23is updated (step S26). More specifically, when image taking is performedin 3D mode, the protect flag that is set to “on” at step S14 is writtenin the header.

In this connection, although in the above description image taking isperformed using one imaging system in the case of vertical shooting,image taking may also be performed with a configuration in which thenumber of imaging systems is reduced from the maximum number.

By automatically setting a protect flag and performing image taking andrecording of a three-dimensional image in this manner, it is possible toprotect a three-dimensional image so that it is not erased even in acase in which a three-dimensional image that is taken using a devicethat supports three-dimensional images is edited or the like with adevice that only supports two-dimensional images.

Further, since the three-dimensional image is protected, a configurationcan be adopted in which the three-dimensional image is not erased evenby carelessness or erroneous operation of the user.

Furthermore, in a case in which a three-dimensional image cannot beacquired because vertical shooting is performed or the like even when inthe 3D mode, the 2D mode can be switched to automatically and theprotect flag can be set to “off”. It is thereby possible to prevent acase in which image data is needlessly protected.

<Case in which Memory Card with Three-Dimensional Image Recorded Thereonis Connected>

A case is now described in which the memory card 38 on which atwo-dimensional image or a three-dimensional image is recorded isconnected to the compound-eye digital camera 1.

Although protection is automatically applied to a three-dimensionalimage taken by the above described compound-eye digital camera 1 at thesame time as the image is recorded, it is desirable to also protect athree-dimensional image that is taken by a compound-eye digital camerathat does not automatically protect three-dimensional images.

Hereunder, a method that automatically applies protection to anunprotected three-dimensional image is described.

First Embodiment

FIG. 4 is a flowchart that illustrates the flow of processing in a casein which the memory card 38 is connected to the compound-eye digitalcamera 1 by a method such as inserting the memory card 38 into a cardslot of the compound-eye digital camera 1. The main CPU 10 performscontrol according to this flowchart.

First, the main CPU 10 determines whether or not an instruction is madeto apply protection to a three-dimensional image, by a menu selection orthe like (step S30). When protection is not to be applied to athree-dimensional image (No at step S30), the processing ends. Whenprotection is to be applied to a three-dimensional image (Yes at stepS30), the main CPU 10 determines whether or not the memory card 38 isinserted in a card slot (step S31). In this connection, a configurationcan be adopted in which the processing of step S30 is omitted andprotection is applied in all cases in which a card is inserted. However,by enabling a selection as to whether or not to apply protection to athree-dimensional image, the degree of freedom for the user's selectioncan be increased.

When the memory card 38 is not inserted in the card slot (No at stepS31), the processing of step S31 is performed again.

When the memory card 38 is inserted in the card slot (Yes at step S31),the main CPU 10 determines whether or not there are images on the memorycard 38 (step S32).

When there are no images on the memory card 38 (No at step S32), theprocessing ends.

When there are images on the memory card 38 (Yes at step S32), the mainCPU 10 determines whether or not a three-dimensional image is includedin the images (step S33).

When there is no three-dimensional image included (No at step S33), theprocessing ends.

When there is a three-dimensional image included (Yes at step S33), themain CPU sets a protect flag for that three-dimensional image to “on”(step S34), and writes the protect flag in the header (step S35).

The main CPU 10 then determines whether or not processing (steps S34 andS35) that sets a protect flag to “on” and writes the protect flag in theheader has been performed for all the three-dimensional images includedin the memory card 38 (step S36).

When the processing of steps S34 and S35 is not completed for all thethree-dimensional images (No at step S36), the processing of steps S34and S35 is performed again.

When the processing of steps S34 and S35 is completed for all thethree-dimensional images (Yes at step S36), the processing is ended.

When the above described processing (step S30 to S36) is completed, allof the processing may be ended, or the aforementioned protect flagsetting circuit 52 may be set to perform processing to take and recordimage data of a three-dimensional image.

Thus, by protecting a three-dimensional image when a card including thethree-dimensional image is inserted, protection can be automaticallyapplied to a multi-viewpoint image that is taken by a device that doesnot automatically apply protection to a 3D/multi-viewpoint image.

Although according to the present embodiment a configuration is adoptedin which insertion of a memory card is detected, and detection is thenperformed with respect to the inserted memory card to ascertain whetheror not it contains image data or files, a configuration may also beadopted in which initially all files and data for three-dimensionalimages are searched, and rewriting of flags is performed based on thesearch results.

Although according to the present embodiment protection is applied (stepS34) to all three-dimensional images, a configuration may also beadopted in which the tag information attached to the three-dimensionalimages is examined and protection is applied only to unprotectedthree-dimensional images, and not to three-dimensional images that arealready protected.

Further, although according to the present embodiment insertion of amemory card is detected and protection is applied to three-dimensionalimages recorded on the memory card, the present embodiment is notlimited to a memory card and is also applicable to three-dimensionalimages recorded on a PC connected to a compound-eye digital camera or aserver connected to via a LAN or the like. In this case, thecompound-eye digital camera may detect the connection to the PC orserver on a network and thereafter perform the processing of steps S32to S36.

Second Embodiment

The first embodiment that automatically applies protection tounprotected three-dimensional images sets a protect flag forthree-dimensional images that are retrieved on the memory card 38.However, a method of applying protection to three-dimensional images isnot limited to setting a protect flag for each piece of image data.

The second embodiment that automatically applies protection tothree-dimensional images applies protection to the memory card itself onwhich three-dimensional images are recorded. FIG. 5 is a flowchart thatillustrates the flow of a series of processing according to the secondembodiment that automatically applies protection to three-dimensionalimages. The main CPU 10 performs control according to this flowchart. Inthis connection, sections that are the same as in the first embodimentare assigned the same reference numerals, and a detailed description ofthose sections is omitted.

First, the main CPU 10 determines whether or not the memory card 38 isinserted in a card slot (step S31). When the memory card 38 is notinserted in the card slot (No at step S31), the processing of step S31is performed again.

When the memory card 38 is inserted in the card slot (Yes at step S31),the main CPU 10 detects the residual capacity of the memory card 38(step S37), and determines whether or not the memory card 38 has aresidual capacity capable of recording newly taken images (step S38).

When the memory card 38 has a residual capacity that is sufficient torecord newly taken images (No at step S38), the processing ends.

When the memory card 38 does not have a residual capacity capable ofrecording newly taken images (Yes at step S38), the main CPU 10determines whether or not to make a setting to apply protection to theentire memory card 38 (step S39).

When protection is not to be applied to the entire memory card 38 (No atstep S39), a warning display to the effect that the capacity of thememory card 38 has run out is displayed (step S43), and thereafter theprocessing is ended.

When protection is to be applied to the entire memory card 38 (Yes atstep S39), the main CPU 10 determines whether or not there is athree-dimensional image in the memory card 38 (step S40).

When there is no three-dimensional image in the memory card 38 (No atstep S40), a warning display to the effect that the capacity of thememory card 38 has run out is displayed (step S43), and thereafter theprocessing is ended.

When there is a three-dimensional image in the memory card 38 (Yes atstep S40), a protect flag for the entire memory card is set to “on”(step S41), and the protect flag is written in tag information or thelike attached to the memory card 38 (step S42).

Thereafter, a warning display to the effect that the capacity of thememory card 38 has run out is displayed (step S43), and the processingis ended.

When the above described processing (step S31 and steps S37 to S43) iscompleted, all of the processing may be ended, or the aforementionedprotect flag setting circuit 52 may be set to perform processing to takeand record image data of a three-dimensional image.

Thus, by applying protection to an entire recording medium on which athree-dimensional image is recorded, protection can be automaticallyapplied to a multi-viewpoint image that is taken by a device that doesnot automatically apply protection to a 3D/multi-viewpoint image.

Further, since double protection consisting of protection of the imageand protection of the recording medium is applied in a case in which aprotect flag is set for a three-dimensional image included in arecording medium, protection of image data can be made more secure.

In this connection, as a warning method, other than a text displaymethod that displays a message on a screen, a method utilizing sound oran alarm or the like may be used.

Further, although according to the present embodiment insertion of amemory card is detected and protection is applied to the entire memorycard, the present embodiment is not limited to a memory card and is alsoapplicable to an image folder on a PC connected to a compound-eyedigital camera or a server that is connected to via a LAN or the like.In this case, the compound-eye digital camera may detect the connectionto the PC or the server on a network, detect whether or not there is animage folder on the PC or server, and thereafter perform the processingof steps S40 to S42.

<Erasing and Editing Three-Dimensional Images>

Erasure and editing of a three-dimensional image that is recorded on thememory card 38 and for with a protect flag is set will now be described.

Since a protect flag is set for a three-dimensional image to protect thethree-dimensional image, the image cannot be erased or edited in thatstate. However, when erasure or editing of the image is necessary in acase where the user recognizes the fact that the image is protected, itis necessary to place the image in a state that enables erasure orediting processing.

Hereunder, a method of erasing and editing a three-dimensional image forwhich a protect flag is set is described.

(Erasing Three-Dimensional Images)

FIG. 6 is a flowchart illustrating the flow of processing to erase athree-dimensional image. To perform this processing, it is necessary topreviously set an erase permitted mode that enables erasure ofthree-dimensional image for which a protect flag is set, using theprotection cancellation switch 7. The main CPU 10 performs control inaccordance with this flowchart.

First, the main CPU 10 determines whether or not the operation mode ofthe compound-eye digital camera 1 is set to an erase mode that is anoperation mode that erases a two-dimensional image or athree-dimensional image (step S50).

When the operation mode is not set to the erase mode (No at step S50),the processing ends.

When the operation mode is set to the erase mode (Yes at step S50), theimage the user wants to erase is selected (step S51). A message warningthe user that the selected image is to be erased is then displayed (stepS52). Selection of an image is performed by depressing the informationposition specification key in a state in which the image the user wantsto erase is displayed on the image display LCD 6. Warning of imageerasure is performed by the main CPU 10 displaying on the image displayLCD 6 a message that conveys the fact that the image will be erased suchas “Okay to erase this image?” over the image via the controller 34.Besides the above kind of text display, a warning may also be givenusing sound or the like.

Next, the main CPU 10 determines whether or not the selected image is athree-dimensional image (step S53). When the selected image is not athree-dimensional image (No at step S53), the main CPU 10 proceeds tosteps to erase a two-dimensional image (steps S63 to S65).

When the selected image is a three-dimensional image (Yes at step S53),the main CPU 10 detects whether or not an erase permitted flag is setfor that three-dimensional image (step S54). An erase permitted flag isa flag that is set only in a case in which an erase permitted mode isset that enables erasure of a three-dimensional image for which aprotect flag is set. The erase permitted flag is set for eachthree-dimensional image for which a protect flag is set.

The main CPU 10 determines whether or not an erase permitted flag is setfor the selected three-dimensional image, that is, whether or not anerase permitted flag is detected at step S54 (step S55).

When the erase permitted flag is not set (No at step S55), since theerase permitted mode is not set, i.e. since that three-dimensional imagecannot be erased, a message is displayed that alerts the user to thefact that erasure of the image is not possible (step S56), and theprocessing is ended.

When the erase permitted flag is set (Yes at step S55), a message towarn the user that the three-dimensional image will be erased isdisplayed (step S57), and the main CPU 10 then detects whether or notthe user inputs an erase instruction (step S58). Input of the eraseinstruction is performed by depressing the information positionspecification key.

The main CPU 10 determines whether or not erasure of the image ispossible based on input of the erase instruction (step S59). Whenerasure is not possible (No at step S59), the main CPU 10 detectswhether or not an erase instruction is input by the user once more (stepS58).

When erasure of the image is possible (Yes at step S59), the main CPU 10cancels the protect flag setting of the three-dimensional image (stepS60), and performs erase processing (step S61). Cancellation of theprotect flag is performed by a system call. The erase processing isperformed by erasing an image file recorded on the memory card 38 viathe I/F 39.

In the steps that erase a two-dimensional image (steps S63 to S65), amessage that warns the user the two-dimensional image will be erased isdisplayed (step S63), and the main CPU 10 detects whether or not theuser inputs an erase instruction (step S64). Input of the eraseinstruction is performed by depressing the information positionspecification key.

The main CPU 10 determines whether or not erasure of the image ispossible based on input of the erase instruction (step S65). Whenerasure is not possible (No at step S65), the main CPU 10 detectswhether or not an erase instruction is input by the user once more (stepS64).

When erasure of the image is possible (Yes at step S65), the main CPU 10performs erase processing (step S61). The erase processing is performedby erasing an image file recorded on the memory card 38 via the I/F 39.

A configuration may be adopted whereby, when the above describedprocessing (step S50 to S65) is completed, all of the processing isended, the erase processing is performed once more, or the compound-eyedigital camera 1 is automatically switched to the image taking mode.

Thus, since a warning is given before erasing a three-dimensional image,it is possible to prevent a user erroneously erasing a three-dimensionalimage.

Further, since erasure of a three-dimensional image can be performedwith a device that supports three-dimensional images as long as thesetting permits erasure of the image, it is possible to erase athree-dimensional image which the device knows may be erased and thereis no necessity to keep unwanted files.

The present embodiment is applicable to not only three-dimensionalimages recorded on an internal memory or a storage medium or the like,but also to three-dimensional images stored on a PC or a server on anetwork. Further, by using a program that causes the above describedprocessing to be performed, the present embodiment can be applied notonly to a compound-eye digital camera but also to a variety of devicessuch as a PC and a terminal for image printing.

(Editing Three-Dimensional Images)

FIG. 7 is a flowchart illustrating the flow of processing to edit athree-dimensional image. This processing is performed in an editpermitted mode that is an operation mode that enables editing of athree-dimensional image for which a protect flag is set. The main CPU 10performs control in accordance with this flowchart. It is possible tostart this processing in a state in which the edit permitted mode isalready set using a setting screen of the compound-eye digital camera 1or the like. In the following description, the same reference numeralsare used to denote processing of steps that are the same as steps of theerase processing for a three-dimensional image, and a description ofthose processing steps is omitted.

First, the main CPU 10 determines whether or not the operation mode ofthe compound-eye digital camera 1 is set to an edit mode that is anoperation mode that edits a two-dimensional image or a three-dimensionalimage (step S70).

When the operation mode is not set to the edit mode (No at step S70),the processing is ended.

When the operation mode is set to the edit mode (Yes at step S70), theimage the user wants to edit is selected (step S51). A message warningthe user that that image is to be edited is then displayed (step S71).Selection of an image is performed by depressing an information positionspecification key in a state in which the image the user wants to editis displayed on the image display LCD 6. The main CPU 10 warns the userthat the image will be edited by displaying on the image display LCD 6 amessage that conveys the fact that the image will be edited such as“Okay to edit this picture?” over the image via the controller 34.Besides a text display, a warning may also be given using sound or thelike.

Next, the main CPU 10 determines whether or not the selected image is athree-dimensional image (step S53). When the selected image is not athree-dimensional image (No at step S53), the main CPU 10 proceeds tosteps to edit a two-dimensional image (steps S78 to S80).

When the selected image is a three-dimensional image (Yes at step S53),it is detected whether or not an edit permitted flag is set for thatthree-dimensional image (step S72). An edit permitted flag is a flagthat is set only in a case in which an edit permitted mode is set thatenables editing of a three-dimensional image for which a protect flag isset. The edit permitted flag is set for each three-dimensional image forwhich a protect flag is set.

The main CPU 10 determines whether or not an edit permitted flag is setfor the selected three-dimensional image, that is, whether or not anedit permitted flag is detected at step S72 (step S73).

When the edit permitted flag is not set (No at step S73), since the editpermitted mode is not set, i.e. since that three-dimensional imagecannot be edited, a message is displayed that alerts the user to thefact that editing of the image is not possible (step S74), and theprocessing is ended.

When the edit permitted flag is set (Yes at step S73), a message to warnthe user that the three-dimensional image will be edited is displayed(step S75), and the main CPU 10 then detects whether or not the userinputs an edit instruction (step S76). Input of the edit instruction isperformed by depressing the information position specification key.

The main CPU 10 determines whether or not editing of the image ispossible based on input of the edit instruction (step S77). When editingis not possible (No at step S77), the main CPU 10 again detects whetheror not an edit instruction is input by the user once more (step S76).

When editing of the image is possible (Yes at step S77), the main CPU 10cancels the protect flag setting of the three-dimensional image (stepS60), and performs edit processing of the three-dimensional image (stepS78). Edit processing is performed by previously registering a pluralityof types of editing contents, selecting the desired editing contentsfrom among the plurality of types of editing contents using theinformation position specification key, and pressing menu/OK to executethe selected editing contents.

When the edit processing is completed, the file of the three-dimensionalimage is updated from the pre-editing file to the post-editing file(step S79), and a protect flag is written with respect to the updatedfile (step S80). As a result, the file of the edited three-dimensionalimage is protected.

In the steps that edit a two-dimensional image (steps S81 to S85), amessage that warns the user the two-dimensional image will be edited isdisplayed (step S81), and the main CPU 10 detects whether or not theuser inputs an edit instruction (step S82). Input of the editinstruction is performed by depressing the information positionspecification key.

The main CPU 10 determines whether or not editing of the image ispossible based on input of the edit instruction (step S83). When editingis not possible (No at step S83), the main CPU 10 detects whether or notan edit instruction is input by the user once more (step S82).

When editing of the image is possible (Yes at step S83), the main CPU 10performs edit processing of the two-dimensional image (step S84) andupdates the two-dimensional image file from the pre-editing file to apost-editing file (step S85). The edit processing (step S84) is the sameas the edit processing for a three-dimensional image (step S78).

A configuration may be adopted whereby, when the above describedprocessing (steps S51, S53, and S70 to S85) is completed, all of theprocessing is ended, the edit processing is performed once more, or thecompound-eye digital camera 1 is automatically switched to the imagetaking mode.

Thus, since a protect flag is automatically set for a three-dimensionalimage, a three-dimensional image will not inadvertently be lost evenwhen using a device that supports only two-dimensional images to performediting or the like of a three-dimensional image that is taken with adevice that supports three-dimensional images.

Further, since a warning is given before executing editing of athree-dimensional image, it is possible to prevent a user erroneouslyediting a three-dimensional image. For example, by previously applying aread inhibit setting to a three-dimensional image using a protect flag,a user can carefully copy a three-dimensional image using a differentfile name and perform editing for the copied three-dimensional image. Itis thereby possible to effectively protect a captured three-dimensionalimage.

Furthermore, by setting a protect flag for an edited three-dimensionalimage it is possible to protect not only the captured three-dimensionalimage, but also the three-dimensional image file after editing.

Also, if a device that supports three-dimensional images is set topermit editing of images, since editing of three-dimensional images ispossible, editing of images on the device is also possible.

When editing of an image is selected, it is possible to copy an image toa file with a name that is close to the file name of the selected imageand edit the copied image.

A configuration may also be adopted that issues a warning again beforerecording. It is thereby possible to prevent recording of athree-dimensional image that is erroneously edited.

The present embodiment is applicable to not only three-dimensionalimages recorded on an internal memory or a storage medium or the like,but also to three-dimensional images stored on a PC or a server on anetwork. Further, by using a program that causes the above describedprocessing to be performed, the present embodiment can be applied notonly to a compound-eye digital camera but also to a variety of devicessuch as a PC and a terminal for image printing.

According to the present invention, since compatibility withconventional standards can be ensured by simply making the presentinvention correspond with devices that conform to 3D/multi-viewpointstandards, the occurrence of problems due to the existence of3D/multi-viewpoint images can be prevented.

In this connection, there is no necessity that a three-dimensional imageby acquired with the compound-eye digital camera 1 as described above,and the three-dimensional image may be acquired by continuous imagetaking by a motion stereo method using a single-eye camera.

1. An image taking apparatus, comprising: an image taking mode switchingdevice which switches between a multi-viewpoint image taking mode thattakes a subject image that is viewed from a plurality of viewpoints anda single viewpoint image taking mode that takes a subject image that isviewed from a single viewpoint; an image taking mode detection devicewhich detects the image taking mode that is switched to by the imagetaking mode switching device; an image pickup device which acquires amulti-viewpoint image or a single viewpoint image that is taken in theimage taking mode that is switched to by the image taking mode switchingdevice; a recording device which records a multi-viewpoint image or asingle viewpoint image acquired with the image pickup device on arecording medium; a protection setting device which, in a case where themulti-viewpoint image taking mode is detected by the image taking modedetection device, sets a protection with respect to a multi-viewpointimage that is recorded by the recording device so that themulti-viewpoint image is not changed; an edit mode setting device which,in a case where images including the multi-viewpoint image are recordedon the recording medium, sets an edit mode that edits a desired imagethat is selected from among the images; an edit mode detection devicewhich detects whether or not the edit mode is set; a protectioncanceling device which, when selection of the multi-viewpoint image isconfirmed in a case where the edit mode is detected by the edit modedetection device, cancels the protection that is set for the selectedmulti-viewpoint image; and an editing device which edits themulti-viewpoint image for which the protection is cancelled by theprotection canceling device, wherein the recording device records themulti-viewpoint image that is edited by the editing device on arecording medium, and the protection setting device sets a protectionwith respect to the edited multi-viewpoint image that is recorded by therecording device so that the multi-viewpoint image is not changed. 2.The image taking apparatus according to claim 1, wherein the imagepickup device comprises: a plurality of imaging systems having aplurality of optical systems and image pickup elements that form asubject image; a driving device which drives the plurality of imagingsystems in a case in which the multi-viewpoint image taking mode isswitched to by the image taking mode switching device, and which drivesa single imaging system in a case in which the single viewpoint imagetaking mode is switched to by the image taking mode switching device;and a drive detection device that detects whether or not driving of theimaging system by the driving device is completed, and wherein, in acase in which the multi-viewpoint image taking mode is detected by theimage taking mode detection device and the drive detection devicedetects that the plurality of imaging systems are not driving, the imagetaking mode switching device switches from the multi-viewpoint imagetaking mode to the single viewpoint image taking mode.
 3. The imagetaking apparatus according to claim 1, further comprising a verticalshooting detection device that detects whether or not the image takingapparatus is in a state that vertically shoots a subject image, wherein,in a case in which the multi-viewpoint image taking mode is switched toby the image taking mode switching device and the vertical shootingdetection device detects that the image taking apparatus is in a statethat vertically shoots a subject image, the image taking mode switchingdevice switches from the multi-viewpoint image taking mode to the singleviewpoint image taking mode.
 4. The image taking apparatus according toclaim 3, wherein the recording device records the multi-viewpoint imagethat is edited with the editing device on the recording device afterissuing a warning.
 5. An image taking apparatus, comprising: an imagetaking mode switching device which switches between a multi-viewpointimage taking mode that takes a subject image that is viewed from aplurality of viewpoints and a single viewpoint image taking mode thattakes a subject image that is viewed from a single viewpoint; an imagetaking mode detection device which detects the image taking mode that isswitched to by the image taking mode switching device; an image pickupdevice which acquires a multi-viewpoint image or a single viewpointimage that is taken in the image taking mode that is switched to by theimage taking mode switching device; a recording device which records amulti-viewpoint image or a single viewpoint image acquired with theimage pickup device on a recording medium; a protection setting devicewhich, in a case where the multi-viewpoint image taking mode is detectedby the image taking mode detection device, sets a protection withrespect to a multi-viewpoint image that is recorded by the recordingdevice so that the multi-viewpoint image is not changed; an erase modesetting device which, in a case where images including themulti-viewpoint image are recorded on the recording medium, sets anerase mode that erases a desired image that is selected from among theimages; an erase mode detection device which detects whether or not theerase mode is set; and an erasing device which, when selection of themulti-viewpoint image is confirmed in a case where the erase mode isdetected by the erase mode detection device, cancels the protection thatis set for the selected multi-viewpoint image and erases themulti-viewpoint image.
 6. The image taking apparatus according to claim5, further comprising: an edit mode setting device which, in a casewhere images including the multi-viewpoint image are recorded on therecording medium, sets an edit mode that edits a desired image that isselected from among the images; an edit mode detection device whichdetects whether or not the edit mode is set; a protection cancelingdevice which, when selection of the multi-viewpoint image is confirmedin a case where the edit mode is detected by the edit mode detectiondevice, cancels the protection that is set for the selectedmulti-viewpoint image; and an editing device which edits themulti-viewpoint image for which the protection is cancelled by theprotection canceling device, wherein the recording device records themulti-viewpoint image that is edited by the editing device on arecording medium, the protection setting device is a protection settingdevice which sets a protection so that the multi-viewpoint image is notchanged or deleted, and the protection setting device sets a protectionwith respect to the edited multi-viewpoint image that is recorded by therecording device so that the multi-viewpoint image is not changed ordeleted.
 7. An image reproducing apparatus, comprising: a connectiondevice to which a recording medium than can record a subject image isconnected; a detection device which detects that the recording medium isconnected to the connection device; a first judgment device which, in acase where connection of the recording medium is detected by thedetection device, judges whether or not a multi-viewpoint image that isa subject image that is viewed from a plurality of viewpoints isrecorded on the recording medium; and a first protection setting devicewhich, in a case where the first judgment device judges that themulti-viewpoint image is recorded, sets a protection with respect to therecorded multi-viewpoint image so that the multi-viewpoint image is notchanged; an edit mode setting device which, in a case where imagesincluding the multi-viewpoint image are recorded on the recordingmedium, sets an edit mode that edits a desired image that is selectedfrom among the images; an edit mode detection device which detectswhether or not the edit mode is set; a protection canceling devicewhich, when selection of the multi-viewpoint image is confirmed in acase where the edit mode is detected by the edit mode detection device,cancels the protection that is set for the selected multi-viewpointimage; and an editing device which edits the multi-viewpoint image forwhich the protection is cancelled by the protection canceling device,wherein the recording device records the multi-viewpoint image that isedited by the editing device on a recording medium, and the protectionsetting device sets a protection with respect to the editedmulti-viewpoint image that is recorded by the recording device so thatthe multi-viewpoint image is not changed.
 8. The image reproducingapparatus according to claim 7, further comprising: a second judgmentdevice which, when connection of the recording medium is detected by thedetection device, judges whether or not a new subject image can berecorded on the recording medium; and a second protection setting devicewhich, when the second judgment device judges that a new subject imagecannot be recorded on the recording medium, sets a protection withrespect to the recording medium so that a multi-viewpoint image or asingle viewpoint image that is recorded on the recording medium is notchanged or deleted.
 9. An image taking apparatus, comprising the imagereproducing apparatus according to claim
 7. 10. An image reproducingapparatus, comprising: a connection device to which a recording mediumthat can record a subject image is connected; a detection device whichdetects that the recording medium is connected to the connection device;a first judgment device which, in a case where connection of therecording medium is detected by the detection device, judges whether ornot a multi-viewpoint image that is a subject image that is viewed froma plurality of viewpoints is recorded on the recording medium; and afirst protection setting device which, in a case where the firstjudgment device judges that the multi-viewpoint image is recorded, setsa protection with respect to the recorded multi-viewpoint image so thatthe multi-viewpoint image is not deleted; an erase mode setting devicewhich, in a case where images including the multi-viewpoint image arerecorded on the recording medium, sets an erase mode that erases adesired image that is selected from among the images; an erase modedetection device which detects whether or not the erase mode is set; andan erasing device which, when selection of the multi-viewpoint image isconfirmed in a case where the erase mode is detected by the erase modedetection device, cancels the protection that is set for the selectedmulti-viewpoint image and erases the multi-viewpoint image.
 11. Theimage reproducing apparatus according to claim 10, further comprising:an edit mode setting device which, in a case where images including themulti-viewpoint image are recorded on the recording medium, sets an editmode that edits a desired image that is selected from among the images;an edit mode detection device which detects whether or not the edit modeis set; a protection canceling device which, when selection of themulti-viewpoint image is confirmed in a case where the edit mode isdetected by the edit mode detection device, cancels the protection thatis set for the selected multi-viewpoint image; and an editing devicewhich edits the multi-viewpoint image for which the protection iscancelled by the protection canceling device, wherein the recordingdevice records the multi-viewpoint image that is edited by the editingdevice on a recording medium, and the protection setting device is aprotection setting device which sets a protection so that themulti-viewpoint image is not changed or deleted, and the protectionsetting device sets a protection with respect to the editedmulti-viewpoint image that is recorded by the recording device so thatthe multi-viewpoint image is not changed or deleted.
 12. An image takingmethod, comprising the steps of switching between a multi-viewpointimage taking mode that takes a subject image that is viewed from aplurality of viewpoints and a single viewpoint image taking mode thattakes a subject image that is viewed from a single viewpoint; detectingthe image taking mode that is switched to; acquiring a multi-viewpointimage or a single viewpoint image that is taken in the image taking modethat is switched to; recording the multi-viewpoint image or singleviewpoint image that is acquired on a recording medium; and in a casewhere the multi-viewpoint image taking mode is detected in the step ofdetecting the image taking mode, setting a protection with respect tothe recorded multi-viewpoint image so that the multi-viewpoint image isnot changed; in a case where images including the multi-viewpoint imageare recorded on the recording medium, detecting whether or not an editmode that edits a desired image that is selected from among the imagesis set; when selection of the multi-viewpoint image is confirmed in acase where the edit mode is detected, canceling the protection that isset for the selected multi-viewpoint image; editing the multi-viewpointimage for which the protection is cancelled; and setting a protectionwith respect to the edited multi-viewpoint image that is recorded on apredetermined recording medium so that the multi-viewpoint image is notchanged.
 13. A program that causes an arithmetic and logic unit toexecute an image taking method according to claim
 12. 14. An imagetaking method, comprising the steps of: switching between amulti-viewpoint image taking mode that takes a subject image that isviewed from a plurality of viewpoints and a single viewpoint imagetaking mode that takes a subject image that is viewed from a singleviewpoint; detecting the image taking mode that is switched to;acquiring a multi-viewpoint image or a single viewpoint image that istaken in the image taking mode that is switched to; recording themulti-viewpoint image or single viewpoint image that is acquired on arecording medium; in a case where the multi-viewpoint image taking modeis detected in the step of detecting the image taking mode, setting aprotection with respect to the recorded multi-viewpoint image so thatthe multi-viewpoint image is not deleted; in a case where imagesincluding the multi-viewpoint image are recorded on the recordingmedium, detecting whether or not an erase mode is set that erases adesired image that is selected from among the images; and when selectionof the multi-viewpoint image is confirmed in a case where the erase modeis detected, canceling the protection that is set for the selectedmulti-viewpoint image and erasing the selected multi-viewpoint image.15. An image taking method, comprising the steps of: connection of arecording medium capable of recording a subject image; detecting thatthe recording medium is connected; in a case in which connection of therecording medium is detected, judging whether or not a multi-viewpointimage that is a subject image that is viewed from a plurality ofviewpoints is recorded on the recording medium; in a case in which it isjudged that the multi-viewpoint image is recorded in the step of judgingwhether or not the multi-viewpoint image is recorded on the recordingmedium, setting a protection with respect to the recordedmulti-viewpoint image so that the multi-viewpoint image is not changed;in a case where images including the multi-viewpoint image are recordedon the recording medium, detecting whether an edit mode that edits adesired image that is selected from among the images is set; whenselection of the multi-viewpoint image is confirmed in a case where theedit mode is detected, canceling the protection that is set for theselected multi-viewpoint image; editing the multi-viewpoint image forwhich the protection is cancelled by the protection canceling device;and setting a protection with respect to the edited multi-viewpointimage that is recorded on a predetermined recording medium so that themulti-viewpoint image is not changed.
 16. An image taking method,comprising the steps of: connection of a recording medium capable ofrecording a subject image; detecting that the recording medium isconnected; in a case in which connection of the recording medium isdetected, judging whether or not a multi-viewpoint image that is asubject image that is viewed from a plurality of viewpoints is recordedon the recording medium; in a case in which it is judged that themulti-viewpoint image is recorded in the step of judging whether or notthe multi-viewpoint image is recorded on the recording medium, setting aprotection with respect to the recorded multi-viewpoint image so thatthe multi-viewpoint image is not deleted; in a case where imagesincluding the multi-viewpoint image are recorded on the recordingmedium, detecting whether an erase mode that erases a desired image thatis selected from among the images is set; and when selection of themulti-viewpoint image is confirmed in a case where the erase mode isdetected, canceling the protection that is set for the selectedmulti-viewpoint image and erasing the selected multi-viewpoint image.